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We provide analytical solutions for two types of random walk: generic random walk (GRW) and 

maximal entropy random walk (MERW) on a Cayley tree with arbitrary branching number, root 

degree, and number of generations. For MERW, we obtain the stationary state given by the squared 

elements of the eigenvector associated with the largest eigenvalue Ao of the adjacency matrix. We 

discuss the dynamics, depending on the second largest eigenvalue Ai, of the probability distribution 

approaching to the stationary state. We find different scaling of the relaxation time with the system 

■ size, which is generically shorter for MERW than for GRW. We also signal that depending on 

the initial conditions there are relaxations associated with lower eigenvalues which are induced by 

symmetries of the tree. In general, we find that there are three regimes of a tree structure resulting 

£SJ ■ in different statics and dynamics of MERW; these correspond to strongly, critically, and weakly 

_^ ' branched roots. 
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O ' I. INTRODUCTION 

<d ; 

After the theory of Brownian motion and diffusive processes was formulated in the seminal works by Einstein [l[ 
and Smoluchowski |2], random walk (RW) models, which stem from time or space discretization of these processes, 
have continuously attracted attention. The most celebrated ones include the Polya random walk on a lattice Q and 
^ ' its generalizations to arbitrary graphs. RW has been discussed in thousands of papers and textbooks in statistical 
physics, economics, biophysics, engineering, particle physics, etc., and still is an active area of research. 

S Mathematically speaking, RW is a Markov chain which describes the trajectory of a particle taking successive 
random steps. For instance, in the case of Polya random walk, at each time step the particle jumps onto one of the 
,: neighboring nodes with equal probability. Generalization of this process to any graph is what we call the ordinary or 
£^ ' generic random walk (GRW). 

Another kind of a RW, one that maximizes the entropy of paths and hence named maximal entropy random 
walk (MERW), has been investigated recently J3, H[. The same principle of entropy maximization earlier led to the 
biological concept of evolutionary entropy Jg, |7[ • It was also used in the problem of importance sampling where it 
y—i • served as an optimal sampling algorithm |8]. Now, MERW enters also the realm of complex networks [jML3l]. Its 
defining feature results in equiprobability of paths of given length and end-points, which means that if information is 
sent between two places, MERW makes it impossible to resolve which route the information has traveled. Another 
unprecedented feature of this RW is the localization phenomenon on diluted/defective lattices, where most of the 
stationary probability is localized in the largest nearly spherical region free of defects [3, Q . It has been illustrated 
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with an interactive online demonstration 14j. In this paper, for the first time we show not only how stationary 
distributions of GRW and MERW differ but also how their dynamics differs on Cayley trees, for which the results are 
obtained analytically. 

The paper is organized as follows: we begin with Sec. II defining GRW and MERW in general. In Sec. Ill we 
restrict our considerations to Cayley trees, for whose adjacency matrix we solve the eigenvalue problem by generalizing 
the method given in [l5j |. The scheme presented there is utilized in Sec. IV, where we determine the eigenvector to 
the largest eigenvalue of the adjacency matrix, and then in Sec. V we generalize part of this result to eigenvectors 
associated with next-to-leading eigenvalues. Sec. VI presents the solution for eigenvalue problem of GRW transition 
| matrix, repeating the order of arguments from Sec. III. Based on results from previous sections, Sec. VII describes 
stationary distributions of GRW and MERW on Cayley trees. Sections VIII and IX concern relaxation times of those 
two random walks, with general remarks in the former and particular results in the latter. Details concerning the 
solution of eigenproblems are to be found in Appendices A and B. 
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II. GENERALITIES 



Let us consider a discrete time random walk on a finite connected undirected graph. We are interested in a class 
of random walks with a stochastic matrix P that is constant in time. An element P,j > of this matrix encodes 
the probability that a particle being on a node i at time t hops to a node j at time t + 1. These matrix elements 
fulfill the condition Y2j Pij — 1 f° r an i> which means that the number of particles is conserved. Additionally, let us 
assume that particles are allowed to hop only to a neighboring node. This can be formulated as Py < Ay, where Ay 
is the corresponding element of the adjacency matrix A of the graph: Ay = 1 if i and j are neighbors, and Ay = 
otherwise. The generic random walk (GRW) is realized by the following stochastic matrix: 



A ■ 



where ki = Y) . Aij denotes the node degree. The factor 1 /ki in the above formula produces uniform probability of 
selecting one of ki neighbors of the node i. Clearly this choice maximizes entropy of neighbor selection and corresponds 
to the standard Einstein-Smoluchowski-Polya random walk. The stationary stateQ is given by 7Tj = ki/ kj . The 
other important type of random walk, maximal entropy random walk (MERW), maximizes the entropy of random 
trajectories. In other words, one looks for a stochastic matrix that maximizes entropy for trajectories of given length 
and given end-points. This is a global principle similar to the least action principle. It leads to the following stochastic 
matrix: 



Ao Woi 



where Ao is the largest eigenvalue of the adjacency matrix A and ipoi is the i-th element of the corresponding eigenvector 
i/>o • By virtue of the Frobenius- Perron theorem all elements of this vector are strictly positive, because the adjacency 
matrix A is irreducible. The stationary state of the stochastic matrix P is given by Shannon-Parry measure [161 ]: 

■Ki = IpQi . (3) 

The last formula intriguingly relates MERW to quantum mechanics. Namely, i/>oi can be interpreted as the wave 
function of the ground state of the operator —A and tpQi as the probability of finding a particle in this state [1, 
The two types, ([T]) and @, of a random walk have in general completely different properties, although on a fc-regular 
graph exceptionally they are identical. 

The stochastic matrix is not symmetric in general, so it may have different right and left eigenvectors: 

P*« = A Q * Q , $ Q P = A Q $ Q . (4) 

Throughout the paper, we consider left eigenvectors to be rows and right eigenvectors to be columns. It can be easily 
seen that all the eigenvalues and eigenvectors of the stochastic matrix P can be expressed in terms of eigenvalues Aq, 
and eigenvectors of ip a of the adjacency matrix A: 

A a tpai 

A Q = , * QJ : = -p 1 , $ ai = IpailpOt ■ (5) 

Ao tpoi 

In particular, Aq = 1, *&oi — 1> an d &0i — V'oi = "oi f° r au The spectral decomposition of P reads 

^^A At$ , = E^^. (6) 

Thus, clearly all properties of MERW are encoded in the spectral decomposition of the adjacency matrix of a given 
graph. In what follows, we analyze the spectral properties of adjacency matrices for Cayley trees, derive the stationary 
state and dynamical characteristics of MERW on these trees, and compare them to GRW. 



1 A stationary state exists if a graph is not bipartite, but even for bipartite graphs a semi-stationary state can be defined by averaging 
probability distribution over two consecutive time steps. 
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FIG. 1. Cayley tree with root degree r = 5, branching number k = 2, and G = 3 generations. 



III. CAYLEY TREE 



Let us consider a Cayley tree with G generations of nodes and a branching number k defined as the number of 
edges that connect a given node to nodes belonging to the next generation. We assume that the root of the tree has r 
edges, which in general may be different from k (see Fig. [I]), and by convention, it belongs to the zeroth generation. 
Consequently, the zeroth generation contains one node, no — 1, the first one n\ = r nodes, the second one ri2 = rk, 
the third one n 3 = rk 2 , and so forth. The total number of nodes in the tree is n — Yl g =o n s ~ ^ + r(fc G — l)/(k — 1). 

The adjacency matrix of the underlying graph reads 



/ B 

Bi 
Bj B 2 



\ 



V 



B G-1 



Bg-i 




(7) 



where the next-to-diagonal blocks B g are rectangular matrices of dimensions n g x n 



s+i- 



B P 



/l 



V 



1 



1/ 



(8) 



Each line of B g contains k unities corresponding to branches leading to the descendent generation. The block Bo 
reduces to a single-row matrix with r unities. The matrices Bj are the transposes of B g 's. 



A. Eigenvalues of the adjacency matrix 



In this section we calculate eigenvalues of the adjacency matrix of Cayley tree using the method described in [if 
The eigenvalues are given by solutions of the equation: 



= det(A - Al) 



D B 
Bj D x B x 

B^ D2 B 2 



G — 1 



D 



Bg-i 



(9) 



where the diagonal blocks D g = — Al are of size n 5 



with no = 1, rii = f, and n g = rk 9 1 for g > 1. In order to 



calculate the determinant we use a sequence of elementary transformations such as additions of multiple of a row to 
another row, leaving the determinant invariant. This way the matrix is reduced to a triangular form with zeros above 
the diagonal. First, we annihilate nonzero elements of the block Bg-i by multiplying rows that contain —A in the 
diagonal block Dq by 1/A and adding them to the corresponding rows in Bg-i that contain unities. This way all 
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elements of Bq-i are turned to zero but at the same time the diagonal block Dq-i is modified to D' G _ x = — ac-il, 
where a G -i = —A + k/X. Now, this procedure can be repeated to set the block Bq 2 to zero by multiplying rows 
that contain diagonal elements of D' G _ 1 by X/aa-i and adding them to rows that contain unities in Bq-2- While 
doing so, we see that the diagonal block Dq_2 has been modified to D G 2 = —a G -2l, where a G -± = —A — k/a G -2- 
Proceeding with this scheme recursively for the whole matrix we eventually obtain a triangular matrix determinant: 



det(A - Al) 



V 



Bf D' a 



B T 



G — 1 



D' 



G 



(10) 



with diagonal blocks D' = a g l of size n g 



whose coefficients are given by 



a G 



a g = — A — k/c 
ao = —A — r ja\ 



■s+ii 



for g = G-1, . . . , 1, 



(11) 



The diagonal coefficients a G (X) = —A, a,G-i(X) = —A — k/X, a G -2 = —A — k/(— A — fc/A), etc., are nested fractions in 
the argument A. Hence, the equation ^ for eigenvalues A takes the following form: 



riMA)p=o 



(12) 



5=0 



ft is convenient to rewrite the left-hand side of the above equation as a product of polynomials instead of fractions. 
There is a natural set of polynomials which can be constructed from a ff 's to this end: 



A (X) 
Ai(A) 
A 2 (A) 



a G = -A, 
aoac-i = X 1 

Q-G&G-\&G-2 



-A(A 2 - 2k), 



(13) 



A g (X) - —XA g -i(X) - kA g _ 2 (X), for g < G, 
A G (X) = -XA G ^(X)-rA G ^(\). 



The recursive formula given above is derived by noticing that A g 



A ff _i(-A - fc/a G _ g+ i) 



— AA g _i — kA g -2- The exception is g = G, since then, in the last step the coefficient k has to be replaced 
by r. Expressed in terms of polynomials A g the equation (|12j) reads 



0, 



(14) 



where m G = 1 and mc-c 



n g _i, for 5 = 1,2, ... ,G, or equivalently m G _i 



1, 



r(fe - l)/c 9 ~ 2 for 



g = 2, 3, . . . , G. A simple analysis of the last equation shows that A g (A) are polynomials of order g + 1. Moreover, 
all odd order polynomials have a root equal to zero. Later, we shall see that the equation A g (A) = has g + 1 real 
roots and that if A is a root, —A also is. The total number of real roots of equation (|T4| counted with degeneracy m g 
is Y^gid + l) TO g = S g n g = n ' so Eq. (HU) gives all n eigenvalues of the adjacency matrix. The equation Aq(A) = 
gives eigenvalues A = with the degeneracy m G ~ r(k — l)k G ~ 2 , the equation Ai(A) = gives eigenvalues ±^/k with 
the degeneracy m G = r(k — l)fc G ~ 3 , etc. It should be noticed that some eigenvalues may be solutions of A g (A) = 
for different g. For instance A = is a root of A 9 (A) = for all even g, so the total degeneracy of the eigenvalue A = 
is E s (2.9 + l)m 2g . 

It turns out that the solutions of equations A g (A) = can be found systematically. The polynomials A g (X) for 
g < G (|13[) can be written in a concise form using an auxiliary parameter 6 (see Appendix : 



Ag = kS 9+l)/2 



sm[(g + 2)0} 



smf 



(15) 
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where 



cost 



2y/k 



(16) 



It can be checked by inspection that these equations indeed reproduce the polynomials ([13)) . For example, for g = 
one retrieves A — ^/ksin(28)/ sin6> = 2\/fccos# = —A; for g = 1, Ai = k sin(30)/ sin 9 = k[4(cos9) 2 — 1] = A 2 — k, 
etc., in agreement with (fT3l) . The equation for Aq can be obtained by combining the last equation in (fT3|) Aq 
A A ( ; i — kAc-2 with the explicit form of j4g_i and Ag_2 p3|) . which yields 



-4 f 



fe(G-l)/: 



. fc sin[(G + 2)6>] + (fe - r) sin(G6>) 



sm ( 



(17) 



where 9 is given by (fT5|) . When the root of the tree has r — k neighbors (equal to the branching number of the tree), 
the last equation reduces to the one for remaining generations (|15[) . 

The eigenvalues of the adjacency matrix can be determined by finding values of the auxiliary parameter 6 for which 
A g (fl5|) and Aq (fTT)) are zero and inserting these values to the formula A = — 2^/kcos9 (TlB]) . As can be seen, A g (fT5)l 
for g < G is equal zero for 9^0 fulfilling the equation 



sm[(g + 2)9} = 



that has q + 1 solutions 



A„ 



2\/fc 



cos 



for j = 1, 



+ 1. 



(18) 



(19) 



Each eigenvalue in this series is m g times degenerated, as follows from . The situation is slightly more complicated 
for g = G, since the equation Aq = amounts to an equation for 9 



k sin[(G + 2)8] + (k - r) sm(G8) = 



(20) 



that can be solved analytically only for r — k or r — 2k. In the first case, exactly the same formula as for g < G (fTi?)) 
is obtained 



\ G ,j = 2Vfc 



cos 



G + 2 



while in the second one 



X G ,j = 2Vk 



cos 



A3 ~ V2) 
G + l 



forj = 1,...,G + 1, 



forj = l,...,G + l 



(21) 



(22) 



For other values of r one has to solve ((20)l numerically. The largest eigenvalue of the adjacency matrix is Ao = Ag,i- 
For r — k it is equal 



Aq — A 



G.l 



while for r = 2k 



Ao = A 



2Vk(. 



2sfk( 



G + 2 



2G + 2 



(23) 



(24) 



For other values of r the eigenvalue Ao can be determined approximately as discussed in Appendix [B] The solutions 
can be divided into three classes with respect to values of r: the first class for r € (0,2k — 2k/G), the second one 
for r € (2k- 2k/G, 2k + 2k/G), and the third one for re (2k + 2k/G, +oo). In the large G limit, i.e., for G > 2k 
the second class reduces to a single integer value of r = 2k for which the solution is known (|2"4")l . The first class 
corresponds to the values r < 2k for which the approximate solution reads 



Ao = 2vk cos 



G + S 1 



(25) 
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where 

2k — r 

as explained in Appendix [Bj For the third class, r > 2k, the equation (I20[) has no real solutions in the range 
(0, 7r/(G + 1)) and the largest eigenvalue Ao is obtained from a purely imaginary solution for 6. The corresponding 
equations change from trigonometric to hyperbolic. For large G the solution can be approximated by 

_ 2Vk 

A ° 7T=^ (27) 



where 



and 



1 - 2 



l + z 



(28) 



?k 

z = 1 - — . (29) 
r 

Again we refer the reader to Appendix [B] for details. One sees that x approaches z exponentially as G grows, so for 
large G one can substitute x by z in (1271) to eventually obtain 

Ao « -y^= • (30) 
x v — k 

As can be seen the largest eigenvalue for trees with a strongly branched root, r > 2k, behaves differently as compared 
to trees with a weakly branched root, r < 2k. This eigenvalue is now larger than 2\J~k, while it was smaller in the 
previous case, it grows with r, and it is weakly dependent on G. 

IV. THE EIGENVECTOR TO THE LEADING EIGENVALUE 

In order to obtain the stationary state of MERW the largest eigenvalue Ao and the squared elements of the eigen- 
vector ipo associated with this eigenvalue are needed: 

(A - A 1)^ = 0. (31) 

The ground state ipo has a helpful symmetry in the sense that all elements i/'oi for nodes in a given generation g are 
identical. So the problem can be simplified by ascribing the same value ip g to all nodes in the generation (henceforth, 
when we write out the elements of the eigenvector, we omit the index corresponding to the eigenvalue): 

V>o = (V>q, V>i .,t/>i , ... , jjG, ■ -j,^g) ■ (32) 

Effectively, instead of n equations for ipgi, i = 1, . . . , n, pip there are just (G + 1) independent equations for t/j g , 
g = 0, . . . , G, left: 

-AoV>o + rtpi = 0, 

ijjg-x - AoVg + = 0, for 5 = l,...,G-2, (33) 

tpG-l ~ AoV'G = 0. 

This recurrence can be solved starting from the end, g — G, and decreasing g to 0. For convenience we introduce 
coefficients 



that invert the order of the recurrence. They correspond to the original values normalized to ipGi m particular Go = 1. 
The recurrence relations (1331) are equivalent to 

C a = A C 9 _! - kC g - 2 , for g = 2,..., G, (35) 
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with the initial condition Cq = 1, C\ = Ao- Let us note that the recurrence relation is identical as for A g (IT3"|) when 
Ao is replaced by — Ao- The initial condition is also identical, except that the counter of the recurrence is shifted by 
one, so the solution can be copied: G s (Ao) = A g -i{— Ao) to obtain 

c k9/2 M(9+m for5=0) ... )G) (36) 

sin 9 

where cos9 = Ao/2v / fc- The first equation in p3[) — Aof/'o + ripi = 0, which corresponds to an equation — AqCg + 
rCc-i = 0, that is automatically fulfilled for Cq and Cq-x given by (|3"5|) under substitution of Ao = 2\fkcos9 and 
r sin(G6>) = fcsin[(G + 2)9] + ksm(G9) according to the equation ([20|) . 

This concludes our calculations of the eigenvector to the leading eigenvalue of the adjacency matrix. Using (fM)) we 
have 

9 = Cg^g = (37) 
for all nodes in the 3-th generation. The value t/'g is chosen to ensure the proper normalization ^ g 0q g = 1. 



V. THE EIGENVECTOR TO NEXT-TO-LEADING EIGENVALUES 



In the case of the eigenvector tp\ to the eigenvalue Ai, we exploit the fact that it is symmetric within each of r 
principal branches of the tree (which means that for given generation g within the branch all the elements tp g are the 
same; once again, when writing out the elements of the vector, we omit the index corresponding to the number of the 
eigenvalue). In appropriate coordinates, the elements belonging to these principal branches can be separated: 

ipi = (ip ,a 1 (j),...,a r 4>), (38) 
where the branches may have different multiplicative factors ot\, . . . , a r and the vector 

$= (lpl, 1p2, ■ ■ ■ ,-02 , ..., fer --^g) , (39) 

represents the relative value of the eigenvector elements in each branch. The multiplicities n g are evenly distributed 
among the r branches, hence the factor 1/r. 

We obtain (G + 1) independent equations for ip g , g = 0, . . . , G, in analogy to the equation (|3"3"1) : 



-Aii/'o + (ai+... + a r )i) X = 0, (40a) 
V'o/cni - Ai^i + fc^2 = 0, for i = 1, . . .,r, (40b) 
tpg-i - Ai^ 9 + fcVv+i = 0, for.g = 2,...,G-l, (40c) 
ipG-i ~ Ai^g = 0. 

The only difference is the first two equalities above, which show how the r branches couple together at the root of 
the tree. The rest of the equalities stay the same, as the recurrence progresses only within a given branch and the 
factor ai is eliminated. 

For each of the branches the system is solved starting from g = G and decreasing g to 1. Until this point the 
solution is the same as before (f31>)) . 

Now, we check if (|40a[ I40b|) are consistent with this solution. Clearly, in equation (|40b|) the terms — Ao'0i + = 
fcG/2 sm[(G+i)6>] ^ _ q ^ ^ ecauge ^ corresponds to the value 9 = gr^- Thus, after rewriting, the equations (|40al I40b|) 
take the form 



ai + . . . + a r = 0, (41a) 
0o = 0. (41b) 

In fact, 0o = is consistent with the explicit solution Cq oc sin[(G + 1)0] = 0. If we recall the form of eigenvalues 
given in (TT9")) , of which one special case was Ai = Ag-i,i> it is noticeable that for each g = 0, . . . ,G — 1 the eigenvalue 
A 9i i corresponds to the angle and so the solution of the recurrence equation vanishes for generation G — g. This 
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is the point at which the symmetry of the corresponding eigenvector is broken. Such a vector to the eigenvalue A ffi i 
has the elements ip g > = for g' < G — g and the symmetric values of ipg' for g' > G — g. We do not discuss here the 
eigenvectors to the other eigenvalues. 

The last point concerns the multiplication factors of branches ai, . . . , a r . Noticeably, one of them can incorporate 
the normalization factor i/}q, which leaves r free parameters. There are however r — 1 eigenvectors in the eigenspace of 
Ai, so there are in fact r{r— 1) parameters [for lower eigenvalues one needs include the degeneration according to (|14p]. 
Now, there are also constraints: r — 1 normalization conditions, r — 1 constraints in (|41bl) . and ( r 2 ^ 1 ) = ( - r ~ 1 ^ r ~ 2 - ) 
pairwise orthogonalizations. This leads to the number 

r (-l>-( r -l)-(r-l)-^M = ^M (42) 

of free parameters, which are the allowed rotations 0(r — 1) of the eigenspace. 

To illustrate this with a simple example let us take r = 3, which gives r — 1 = 2 eigenvectors to Ai: 

ip = (0,aiipi,...,a 3 ipi, ... ,a!ip G ,...,a 3 ^ G ), (43) 
$= (0, Mi,..., fo<t>i, ■■■ ,Mg,.-.,Mg)- (44) 

Two normalization conditions, for </> and ip, rid the equations (|41ap of two parameters: 

at + a 2 + 1 = 0, (45a) 
ft. + fa + 1 = 0, (45b) 

while the orthogonalization tj> ■ ip = gives 

ai/3i+a 2 /3 2 + l -0 (46) 
and finally the symmetric relation between the two vectors is obtained, leaving one free parameter that rotates them 

2 + «!+/?! + loixfa = 0. (47) 

VI. THE EIGENVALUES OF THE GRW TRANSITION MATRIX 

Under the same procedure of transforming the determinant to the triangular form, as explained in Sec. IIII1 the 
transition matrix of generic random walk defined in (TTJ) leads to similar recurrence equations as in (??) 

a G = -A, 

x k 1 
k+lao 

ai = -X- * 1 , for.g = G-2,...,l, (48) 

(k + iy oj+i 

a = -A - — - — . 

k + 1 ai 

In the last equality, the factor r appears in the numerator and denominator, so it cancels out, and the equations 
remain r-independent. 

We proceed as before and define 

g 

^ fl (A) = n a G-i(A), for ff = 0,..., G (49) 

3=0 



and hence we get the recurrence relations 



k 

A g (X) = —AAg-i(X) - (fc + 1)2 A g _ 2 (A), for g < G, 



A G (\) = -\A G _ 1 (\)-j j -^A G _ 2 (\). (50) 
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The general solution for g < G is (see Appendix [5] for details) 



4, (A) 



(k + l) 2 



(ff+l)/2 



sin[(g + 2)6) -ksm(g9) 



sm f 



for g = 0,..., G- 1, 



(51) 



where cos 6 = ^ ■ ^g(A) can be found by inserting the above solution to Eq. ([5 



A G (A) 



L(fc + i) 2 



(G+l)/2 



(2fccos6»-l-fc 2 )sin(G6l) 
ksmO 



(52) 



Now, the eigenvalues of GRW transition matrix are determined by finding values of the auxiliary parameter 9 for 
which A g (I5T1) and Aq (|5"!?|) are zero. We first solve the equation for g = G, which factorizes into two parts: 



2fccos(26>) = 1 + fc 2 , 
whose solution is the largest eigenvalue of the transition matrix 

A = 1, 

the second part being 



sin(G0) = 0, 



which gives 



A G j - 2, 



k 



(k + iy 



TTJ 

2 cos { - 



for j = 1, 



For g < G we obtain 



sm[(g + 2)9) = ksm(g9), 



(53) 
(54) 
(55) 

(56) 
(57) 



which has the same form as equation (j20|) . but with different coefficients. For k > 1 in (|57)) . we enter the same range of 
parameters as for r 6 (2fc + 2fc/G, +oo) in Eq. (|2"0)) , which means that the solution leading to the largest eigenvalue in 
a given series is imaginary. The corresponding equations change from trigonometric to hyperbolic. Under substitution 
h ~j, where z was given in (|2"9"|) . definition (|2"5| reads 



iu — £+! 

^ — l-z ' ^ fe+ 



fc- 1 
fc+ 1 



1 - 2fc-^ +1 ) 



(58) 



We are particularly interested in the second largest eigenvalue (corresponding to the series g = G — 1). For large G 
the solution is approximated by 



A x =24 



1 



(k + 1) 2 yr 



(59) 



and it can be easily seen that Ai exponentially approaches Aq = 1 for large G. 



VII. STATIONARY STATES OF GRW AND MERW ON CAYLEY TREES 

As mentioned earlier, a stationary state for a random walk on a graph exists if the graph is not bipartite. In the case 
of bipartite graphs a semi-stationary state can be defined by averaging probability distributions over two consecutive 
steps (because even and odd times are independent) or by averaging the state over initial configurations. 

The stationary state of GRW of is given by the linear dependence on the degree of the vertices 



for i = l, 



(60) 
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so the distribution is flat (degree fcj = k + 1) but for the root (degree r) and leaves (degree 1) 
probabilities over whole generations the exponential factor appears: 

k 2 - 1 

7-1 K 1 



n„ 



k 9 ~ 



k G -T 



for g = 1, . . . , G and i G g. 



If we sum the 



(61) 



The stationary state of Maximal Entropy Random Walk is given by squared elements of V'O: the eigenvector to the 
largest eigenvalue of the adjacency matrix: 



Remembering the solution (l37|) 

■Ki oc k G ~ 9 sin[(G - g + 1)0] 2 , for g = 0, . . . , G and i € g, 
where we omitted the normalization factor. As we sum the stationary probability over igjwe get 



n„ 



UgTTi (X 



fc 6 " 1 sin[(G - g + 1) 



for g = 1, . . . , G and i € g, 



(62) 
(63) 
(64) 



where the only exception is g = with its uq = 1. Exemplary probability distributions n g for MERW and GRW are 
shown in Fig. [2] 

Now, as this result depends on 9 and the solutions for A depend on whether r < 2k, Eq. (|2~T1) . r = 2fc, Eq. (|2"2"j) . or 
r > 2fc, Eq. (|27[). this means that we can get different distributions for different choices of r. For r < 2k, parameter 
^ ~ an d the distribution remains a sine square; for r = 2k, 9 = jJ-^ and the distribution becomes a cosine 
square; for r > 2k, 9 — i arctanh x [where x is given in (|28|l and i is the imaginary unit], thus we obtain a hyperbolic 
sine. Figure [3] illustrates these cases. An interactive demonstration showing these results as well as finite-size effects 
is available online [17j . 
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FIG. 2. Finite-size effect: the broken lines correspond to the distribution II 9 for G = 5, . . . , 45 in steps of 10, for a tree with 
k = r = 3. (a) The distributions for MERW. For r < k the corresponding curves would be skewed and would approach the 
limiting distribution from the right, while for r > k from the left, (b) The distributions for GRW. The larger the number of 
generations, the more peaked the distribution. 



VIII. RELAXATION TIMES 



General considerations 



Let us denote the probability of finding a particle at a node i at time t of random walk by 7Tj(£) and the proba- 
bility distribution on the whole graph {iri(t)}i—i n by n(t). Given the initial probability distribution 7?(0) and the 
stochastic matrix P one can determine the distribution at any time t 



jf(t) = 7?(0)P* 



(65) 



A General considerations 
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0.0 0.2 




FIG. 3. (a) Plots for Tl g , which is a total probability for a generation. Curves for large G: a sine square for r < 2k, cosine 
square for r = 2k, and hyperbolic sine for r > 2k (k — 3 and r = 3, 6, 9). (b) Probability per one node n g for r = 3, 6, 9, G — 20. 



Using the spectral decomposition of the stochastic matrix ([6]) one can rewrite the last equation as 

7? (i) = CcX$ Q . (66) 

a 

where c Q is a spectral coefficient: c Q = 7?(0) • <5 a = ^ ^i{0)^ai- In particular Co = J2i n i(®) = 1- ^ n general all 
eigenvalues A Q of the stochastic matrix are known to be located inside or on the unit circle in the complex plane 
I A a | < 1. In the limit t — > oo all terms in the sum on the right-hand side of the last equation for |A Q | < 1 are 
suppressed exponentially, and only those for |A Q | = 1 survive. The stochastic matrices for GRW or MERW on trees 
have only two eigenvalues on the unit circlc0: Ao = 1 and A n = — 1, so for large t one has 

7f(f) « c $o + {-fcn^n- (67) 

The eigenvectors associated with the eigenvalue Ao = 1 are = 1 f° r an h = V'oj = n i- ^ n order to write 
down the eigenvectors associated with the eigenvalue A„ = — 1, it is convenient to bipartition the graph into nodes 
belonging to generations numbered by odd and even g. Naturally, the "odd" nodes are neighbors of "even" ones only 
and vice versa. Elements of the eigenvectors are ^ n j = 1, ^nj e = ~ 1> ^nj = ftj and ^ n j e — ~ 7r je.i where the index 
j runs over odd nodes and j e over even nodes. This gives for large t 



TT jo (2t) = 2an jo , ^jA 2t ) = 2(1 - cr)^- 

n jo (2t + 1) = 2(1 - a)n jo , n° c (2t + 1) = 2an jc 



(68) 



where a is the probability that a particle is in the odd part. Clearly, c„ = 2a — 1 and for a — 1/2 the stationary state 
is recovered. The equations above tell us that the probability distribution oscillates between odd and even nodes. In a 
single step of a random walk particles disappear from odd nodes to appear on even ones and vice versa. If one traces 
the state of the random walk process every second step one sees that the distributions of particles on odd and even 
nodes approach the stationary state in each partition. The relaxation to the stationary state is generically governed 
by the next-to- leading eigenvalue Ai and its negative partner A n _i = — Ai. The corresponding term in the spectral 

decomposition (j6"6")l reads ( c i^i + ( — )*Cn-i^n-i) A* and its contribution to the sum vanishes exponentially as 

exp(— t/ri), where n = [— ln(Ai)] -1 = [ln(Ao/Ai)] . The symbolic sum indicates that all eigenvectors in the 
eigenspaces of Ai and A n _i are taken into account. The exception is the case when the corresponding spectral 
coefficients c\ and c„_i vanish, since then also the corresponding term vanishes. In that case the next-to-leading 
contribution in the large t limit comes from a lower eigenvalue Afe, the largest with a non- vanishing spectral coefficient. 



2 More generally, since trees are bipartite one can show that if A is an eigenvalue then also —A is. 



C Critically branched root 



12 



Thus, by t\ we denote the generic relaxation time, the largest one, and by T2 the one associated with Xq,2 (in 
the Sec. IVIII HI we explain what symmetries lead to this relaxation). As there are several tree parameter regimes 
which yield different results for adjacency matrix eigenvalues, the relaxation times for MERW in those cases are also 
different. As explained in Appendix iBl for eigenvalues of the adjacency matrix the relation Ag_i,i > Ag,2 always 
holds, so the second largest eigenvalue is Ai = Ag— i,i ; unless some special parameters k,r are chosen. Thus, we 
discuss below strongly, critically, and weakly branched root, and then some special cases. The discussion of relaxation 
for GRW and remarks on numerical measurements conclude this section. An interactive demonstration illustrating 
the results concerning relaxation is available online 



B. Strongly branched root 



The strongest root branching that yields qualitatively distinct behaviour of MERW is r > 2k, where k > 1 is 
assumed. The largest eigenvalue Ao is given by (I2T|) . while the second largest eigenvalue, with multiplicity r — 1, 
belongs to the second level of hierarchy of eigenvalues 



Ai = Ag_ 1,1 = 2Vfccos ( -^-j ) . (69) 



Thus, the generic relaxation time reads 



ri = - In 



X* COS 



G+l 



(70) 



where x, defined in (|2"5|) . approaches r exponentially fast when G — > 00. Hence, asymptotically: 



C 7T 1 , , 

Ti=cH — Q2+--- — >c = const., (71) 



where 



c=(\n \ , (72) 

V 2y/(r-k)k) 

which gives an extremely fast relaxation, with the relaxation time converging to a constant for large G. A faster 
relaxation resulting from symmetry and associated with the eigenvalue Ag,2 can be found as well, however the 
relaxation time might only be improved by a multiplicative constant. 



C. Critically branched root 



The behaviour of MERW changes for the special case of r = 2k, k > 1, as could be observed in the stationary 
states. The largest eigenvalue is given by (|2"2"j) and the second largest eigenvalue Ai = Xg-i,i as before, hence the 
asymptotic relaxation time is 



n 



8G 2 
3tt 2 



The symmetry-induced relaxation corresponding to Xq,2 
same scaling with respect to the number of generations 



16G 
3^ 



(73) 



2\/A:cos ( ^ , produces asymptotic behaviour with the 



T2 = 



It is worth noting that, while the number of vertices n 
the system size t\,ti ~ Inn, which still is rather fast. 



:G 



(74) 



k , the probability distribution relaxes as a logarithm of 



F Linear chain 
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D. Weakly branched root 

After passing the critical value of r = 2k the tree enters the regime of weakly branched root, where 1 < r < 2k, k > I. 
The only exact solution for Ao in this range of parameters is r — k in (|2ip , otherwise there is the approximation (|25[) 
to our disposal. The second largest eigenvalue is the same as above, Ai = Ag-i,i- Hence, the generic relaxation 
follows 

n = 2-G 3 + \ > G 2 + ... 75 

and the faster relaxation relying on Xq.2 gives 

2 8k 

T ^^ G2 -3^~2k) G+ ---- < 76 > 

Noticeably, the generic relaxation time t\ is G times longer than ti and than both relaxation times for the tree with 
a critically branched root. 



E. Planted tree 

Until now we have considered only the root of degree r > 1, where all the levels in the hierarchy of the eigenvalues 
have a non-zero degeneracy. Trees with a root of degree r = 1 (known as planted trees) are a special case, because the 
level Xg—ij of the hierarchy has degeneracy mc-i = T — 1 = 0. Thus, the second largest eigenvalue is Ai = Ag-2,1) 
while Ao is approximated by (|25[) and the generic relaxation time is given by 

The faster relaxation remains associated with the eigenvalue \g,2, so the asymptote (|76p is still valid for T2 after 
inserting r = 1. 



F. Linear chain 

Parameters k = 1, r = 1 produce a particularly degenerate case of a Cayley tree, namely a linear chain. While 
thg-i = r — 1 = and rriG-g = r(fc — l)/c 5 ~ 2 = 0, there remains only one level in the hierarchy of the eigenvalues of 
the adjacency matrix 

A G , i = 2VfccoJ^-), j = l,...,G + l. (78) 
Naturally, Xc,i > j f° r i < h so = Ag,i and Ai = Ag,2, hence 



8G* 



and the relaxation connected with the third eigenvalue 



C 2 C 

t*=^+- 2 +-- (80) 



7T Z 



However, if the number of generations G is odd {n even) there does not exist a central vertex, where this relaxation 
could be measured. If G is even (n = G+ 1 is odd; it actually might be translated to r' = 2, k' = 1, G' = G/2 Cayley 
tree, although the solution differs from the previous ones) one central node exists and the faster relaxation can be 
measured there or if some symmetric initial conditions are taken. 

Finally, let us notice that the system size is n = G + 1 and the scaling is t\ , Ti ~ n 2 . This is the same result as for 
a simple diffusion, which is modeled by GRW. 
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G. GRW relaxation times 

For GRW Aq = 1 and the second largest eigenvalue is given by ([55)1 for all k > 1 . It follows that the relaxation time 
is given by 



r / (fc-i) 2 4fc G -i xi : 

After using Taylor expansion, in the limit of large G 



(81) 



n - jj-jy^, (82) 

which means that t± ~ n. 

The eigenvalue associated with the faster relaxation is Xg,i and it leads to the characteristic time 

c 2 tt 2 1 , . 

r 2 = c — t^- + ... — > c = const., (83) 



2 G 2 



where 




(84) 



H. Numerical measurements 

It is possible to measure the relaxation process in two ways: either explicitly taking powers of the transition matrix 
or Monte Carlo simulation with N walkers traversing the graph. 

In the former case: compute the transition matrix P, choose the initial conditions (initial probabilities for any 
vertex of the graph), obtain the power of the transition matrix P* (one might use spectral decomposition for that, 
although for large t better precision is needed) corresponding to probabilities after t steps, and measure the difference 
between the stationary state we have found theoretically. One might need to take the average of two consecutive steps 
to avoid the odd-even blinking. 

In the case of Monte Carlo, let N walkers start from node a (or a set of nodes), every sweep for each of those walkers 
draw a random number and check it against the transition matrix to know in which direction the walker should go. 
At a node b measure the number of random walkers at the sweep t, normalize it to the total number of walkers, and 
subtract the stationary state probability. 

We have confirmed the theoretical relaxation times in both ways. 

The difference between the the stationary state and the probability at time t might be averaged over all nodes of 
the tree. However, to observe both the generic and the faster relaxation one might do one of the following: 

1. take one initial vertex with probability 1, one measuring vertex, 

2. take r initial vertices with probabilities pi,p2, ■ ■ ■ ,p r , one measuring vertex. 

In the first case, if the initial vertex or vertex at which one measures probabilities is the root, the observed relaxation 
time is r 2 and t\ otherwise. In the second case, if the vertices and probabilities are chosen symmetrically (e.g., for 
r = 2, the two neighbors of the root with probabilities 1/2 each) one also sees r 2 if measuring the relaxation in the 
generation g = 1. An interactive demonstration allowing to study this behaviour is available online (l^ |. 

In general, one might spot other relaxations upon specific choices of initial conditions. This may be seen as 
eliminating contributions from given eigenvalues in the spectral decomposition of P ©, as explained in Sec. IVIH Al 
Intuitively, this is the same phenomenon as interference of waves, although we deal with probability waves here. 

IX. CONCLUSIONS 



In this paper, we have analytically derived the form of the stationary state for GRW and MERW on Cayley trees, 
which shows that the stationary probability of the latter is centered around the root of a tree in contrast to the flat 
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distribution of the former. The dynamics of the probability approaching to the stationary state have proven to be 
generically faster for MERW (logarithmic with respect to the system size) than for GRW (linear w.r. to the system 
size). 

While Maximal Entropy Random Walk is defined so as to keep all paths of a given length between two given points 
equiprobable, it might be considered a process capable of hiding the route the information has travelled, e.g., on the 
Internet. The properties of stationary probability distribution of MERW have already been used to enhance centrality 
measures in complex networks [l^l ■ Considering the faster dynamics of MERW and the connection of eigenvalues of 
the adjacency matrix to the paths' statistics (which are a basis for a number of community detection algorithms 19]), 
this type of random walk may prove useful in finding community structures on complex networks. 
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Appendix A: Difference equations 



In this Appendix, we provide the reader with a detailed solution of the recurrence equations (IT5|) resulting in 



A g = - AA 9 _i - fcA 9 _ 2 , for. 9 <G, (A.l) 
Ag = - AA G _i - rA G ^ 2 - 

These difference equations can be solved with two initial conditions 

t : t < A - 2 > 

where the first condition is found in (|13|) and the second condition is chosen so as to stay in agreement with the 
recurrence relation (indeed, A% = — XAq — kA-\ — A 2 — k). 

The characteristic polynomial of this difference equation yields a 2 + Xa + k = 0, resulting in a — 4(— XztiyAk — A 2 ), 
and using the notation 



cos6» = -X/2yfk, 
sin 9 



(A.3) 



the general solution is obtained 

A g = fc (9+1)/2 [aicos( 5 (9) + a 2 sm(g6)}, for g = 0, . . . , G - 1. (A.4) 
The first and second initial condition, respectively, lead to 



a.\ = 2 cos 9, 

_ cos(2fl) 



(A.5) 



a 2 

after insertion of which the solution takes the form 

A = /;(q+1 )/ 2 sin(2fl)co S (fl g ) +cos(2fl)sin(fl g ) = fc(g+1)/2 sin[fl(G + 2)] fo Q 
9 sin0 sin 9 

The last value, Aq is calculated separately due to the root having degree r that may be different from k: 

Ag = jjG-D/2 k sin[fl(G + 2)] + (fc - r) sin(flG) _ 

sin^ 

In the case of GRW, the recurrence equations are given by (|50[) . The solution proceeds analogously, however, due 
to different coefficients the initial conditions need to be adjusted accordingly: 
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The general form of the solution remains the same as given above but for the prefactor fc(f+ 1 )/ 2 substituted with 
[k/(k + l) 2 ] ' 9+1 '' /2 . The first and second initial conditions give 

Q'l = 2 COS0, 

_ cos(2fl)~fc (A. 9) 

a 2 ~ sinS ' 

which eventually lead to the solutions [ (15T1) . (|5^j) ]. 



Appendix B: Trigonometric equations 

In this Appendix, we derive more detailedly the approximate solutions to the trigonometric equations that appeared 
earlier in the article. The equation (|2"0)) can be illustrated with Fig. 2] For r = k and r — 2k the analytical 
solutions (12"TT) and (|2"2"j) are found immediately. As mentioned in Sec. IIII AI for other values of r the solutions can 
be divided into three classes with respect to values of r: the first class for r £ (0,2k — 2k/G), the second one for 
r £ (2k- 2k/G, 2k + 2k/G), and the third one for r £ (2k + 2k/G, +oo). In the large G limit, that is for G > 2k 
the second class reduces to a single integer value of r = 2k (although for small G one can find several values, e.g., for 
G = 3,fc = 3,r = 7 the solution is still real). 



r»2k ,.-*'*" r>2k ****»»„ 

». 




FIG. 4. (Color online) The intersection of the black curve with the other ones marks the solution of Eq. (|20|l . The uppermost 
brown dotted curve corresponding to a strongly branched root shows no real solutions. The blue dot-dashed sine is an example 
of the rare case of strongly branched root with a real solution. The green dashed line is the critically branched root and the 
red continuous lines correspond to weakly branched roots. 



As regards the first class r < 2k, an approximation of the smallest 9 (the largest A) for large G can be derived in 
the following way: let us transform equation (|2ip into 



tan [((7+1)0] 



r -2k 



tan 8, 



(B.l) 



In the limit G — > oo we expect 9 — > (as we do observe such behaviour for r = k and r — 2k), and upon Taylor 
expansion we obtain 



tan [(G + 1)8} S 



(G + l) 10. 
(G+l) (V 



7T 



G + l 
G + l 



r -2k 
arctan 
r 

r-2k 



(9 + 3 /3) 



2k 



Q(9 3 ). 



Which, when having denoted by 8 : 



2k 
2k-r 



, finally leads to 



73) 



(B.2a) 
(B.2b) 
(B.2c) 



G + S 



(B.3) 
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and produces the asymptotic solution (1251) for the first level of eigenvalues in the limit G — > oo for any branching 
parameters k,r < 2k. 

For the third class r > 2k, the equation ((20)) has no real solutions in the range (0, ^rj ) an< i the largest eigenvalue 
Ao is obtained from a purely imaginary solution for 8. The corresponding equations change from trigonometric to 
hyperbolic, so after transformation of ([2~T]) one gets 



For G — > oo this equation approaches 



which gives 



tanh UG + 1)8} = — r — tanh 8. (B.4) 

r — 2k 



1 = tanh0*, (B.5) 

r — 2k 



' r — 2k s 

arctanh ( I . (B. 



With the notation z = 1 — — and after utilizing the identity arctanh(z) = | ^(i^f ) 

(G+ 1)8 = iln Qtanh0 + 1^ -^kifl - -tanh^ . (B.7) 

For large G the first term on the right-hand side approaches \ In 2, while the left-hand side (G+ 1)8* . After rearranging 
this equation: 

9 9i arctanh {z [1 - exp (In 2 -2(G+ 1)0*)}}, (B.8) 
and finally under substitution of 8*: 

-(G+l)- 

1 -2 ' ' 



8 = arctanh 



( 



1 + z 

1 - z 



(B.9) 



The final solution (j27l) for Ao is due to the identity cos(i arctanhx) = -yj=f ■ 

The last remark concerns the problem of which eigenvalue X g j is the second largest one. If r > 1, the level G — 1 
of the eigenvalue hierarchy exists. The eigenvalue Xg-i,i is defined by the angle #g-i,i = gTT' wnereas the second 
eigenvalue in the first level Ag^ is defined by an angle 8q i > ^. The latter information can be easily deduced from 
Fig. |U where the intersections below the angle ^ correspond to the largest eigenvalue. Thus, 8q-i,i < @G,2 and 
consequently Ag_i i > Ac. 2- As this argument holds in general, Ai = Xg-i,i- 
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